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Abstract 

We study a dynamical system with time dependent Hamiltonian by numeri- 
cal experiments so as to find a relation between thermodynamics and chaotic 
nature of the system. Excess information loss, defined newly based on Lya- 
punov analysis, is related to the increment of thermodynamic entropy. Our 
numerical results suggest that the positivity of entropy increment is expressed 

by the principle of the minimum excess information loss. 
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Boltzmann found a famous formula which relates thermodynamic entropy with a number 
of states in microscopic systems. While the formula was practically well-established, there 
have been discussions on its justification over the century In particular, understanding 
the origin of irreversibility seems to be controversial even to the present knowledge. On the 
other hand, owing to development of computational circumstance, we can easily investigate 
numerical solutions to equations of motion in Hamiltonian systems with a high degrees of 
freedom. Thus, through numerical experiments, it may be possible to get new insights 
for the relation between thermodynamics and dynamical systems. In particular, we are 
concerned with a question how thermodynamic entropy is related to notions of dynamical 
system theory. 

We study numerically a Fermi- Past a- Ur am (FPU) model , whose Hamiltonian is given 

by 

N 1 1 a 
H({ qi }, fe}; g) = + - *) 2 + f(ft+i " ft) 4 ]. (!) 

i=l 

where g is a time dependent parameter. Then, the evolution equations for ({%}, {pi}) are 
written as 

n =p - (2) 

= (ft+i - ft) + 9(li+i ~ Qif ~ (q% - ft-i) - g(q% - Qi-if ■ (3) 

We assume periodic boundary conditions, that is, go and qN+i in Eq.(Q) satisfy go = Qn and 
qN+i = qi- We also assume that the values of conserved quantities Y^%q% and J2iPi are zero. 
We solve numerically Eqs.(0) and (Q) by the 4-th order symplectic integrator method with 
a time step St = 0.005 [Q. When we are concerned with the system in the thermodynamic 
limit, numerical calculation should be done with several values of N. In the argument below, 
results for = 5 and N = 20 will be presented. 

We first discuss the case that g takes a constant value, say go. We assume that initial 
conditions are chosen from the micro-canonical ensemble with an energy E . When E g 
is sufficiently large, the system exhibits high-dimensional chaos. As an example of such 



parameter values, (E ,g ) = (1.0, 10.0) is assumed. The nature of high- dimensional chaos is 
characterized by Lyapunov spectrum and Kolmogorov-Sinai (KS) entropy. We first review 
briefly how to obtain them numerically. This is a well-known fact, but will help us to 
introduce a new quantity "excess information loss" later. 

Let a solution to Eqs.(^j) and @ denote T(t) = (qi(t) , Pi(t) , q2(t),P2(t), ■ ■ ■ ,qN(t),PN(t)). 
In Lyapunov analysis, divergence and convergence of distance between neighboring orbits 
are described by time evolution of a set of 2N orthogonal unit vectors, {ej}^, each of 
which obeys the linearized equations of Eqs.(^) and (|]). By employing the Gram-Schmidt 
procedure, which was developed as a numerical calculation method for Lyapunov exponents 
0, the evolution of ej, T(t, 0)ej, is expressed by 

f(t,0)e i = J2F(t,0)e J R Jl (t,0), (4) 

j 

where R+j is the element of an upper triangle matrix R, and F(t, 0) is an orthogonal 
matrix. We can find the matrices R and F so that the diagonal elements of R are positive. 
Note that {F(t, 0)^}^ gives an orthogonal set defined in the tangent space at the point 
T(t). From the definition of the matrix R, the j-dimensional parallelepiped volume spanned 
by {T(t, 0)ei}{ =1 is calculated as 

n j (t,0;{e i }) = IL i < j Rii(t,0). (5) 
The z-th Lyapunov exponent Aj is then defined by 

A, = lim bog (6) 
i-oo t 8 n,_ 1 (i,0;{e i }) ^ ' 

All Lyapunov exponents for the model in question are shown in Fig. [IJ. Note that there are 
four zeros due to the periodic boundary conditions. Further, the KS entropy h is given by 



h= E (7) 

Ai>0 

Since the number of positive Lyapunov exponents is N — 2, the KS entropy is expressed by 



h = pm -logfiAr_ 2 (t,0; {e, ; }). 



(8) 



We also define a special orthonormal set {e*}^ at a point T(0) by 



lim F(0,t b )e, 



■1 ; 



(9) 



where {ej} is an orthonormal set defined in the tangent space at Y(tb)- e* corresponds to 
the i-th Lyapunov vector at a point T(0). 

Now, we consider the case that the value of g is changed in time from go to g±. Especially, 
we pay attention to two limiting cases of the parameter change, quasi-static process and 
instantaneous switching process. In a quasi-static limit, the parameter is changed in a 
slower way than all physical time scales. Since thermodynamic entropy in isolated systems 
should be kept at constant in quasi-static processes, equi-entropy lines in the (E, g) plane 
can be obtained numerically by quasi-static processes. Figure ^ shows the equi-entropy line 
through (Eq, go), which is denoted by E = E qs (g). We also define E*(E, g) by a requirement 
that (E*,0) is on the equi-entropy line through (E,g). Since the FPU model with g = is 
nothing but the harmonic oscillator model, we can evaluate the entropy at (E, g) as 



where an additive constant with respect to E* is omitted, and the Boltzmann constant is 
assumed to be unity. 

Instantaneous switching is the other extreme limit of the parameter change. The value 
of g is changed instantaneously from go to g\ = go + Ag at t — 0. Then, the energy after the 
switching becomes Ex, whose value depends on the choice of initial conditions. The entropy 
difference AS can be defined by 



where S is calculated by the formula Eq. fllOD . In Fig. |||, the average of the entropy difference 
over initial conditions (AS) was plotted against Ag. In the thermodynamic limit, the relative 
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S(E,g) = S(E,(E,g),0) = (N - 2) log E m {E, g) 



(10) 



AS = S(Ex,gx)-S(E ,g ) 



(11) 



fluctuation of E\ becomes negligible and then E\ can be identified with the averaged value 
(Ei). Note that (Ei) satisfies 



That is, (Ei) is determined in such a way that {(Ex), g{) is in the straight line contacting to 
the equi-entropy line E = E qs (g) at (E ,g ). (See Fig. |[) We also confirmed this statement 
numerically. Since the equi-entropy line is convex in the (E, g) plane, the entropy difference 
between the states ((Ei),gi) and (E ,g ) turns out to be always positive. In fact, in Fig. ||, 
S((Ei),gi) — S(E ,g Q ) was shown against Ag. One may find that how AS approaches to 
S((Ei),gi) — S(E ,g ) as N is increased. 

We now attempt to express AS" at instantaneous switching in terms of notions of dy- 
namical system theory. One may naively expect that thermodynamic entropy is related to 
KS entropy. In fact, the extensivity of KS entropy suggests a relation with thermodynamics. 
However, since KS entropy has the same dimension as the inverse of time, the relation is 
not straightforward. Further, we should notice that KS entropy measures the rate of infor- 
mation loss at a steady state in dynamical systems, while thermodynamic entropy changes 
only by external action. We thus expect that AS is related to the change of information loss 
brought by the parameter switching. Motivated by this picture, we next define the excess 
information loss. 

Since the parameter is switched instantaneously at t = 0, the orbit is not smooth at this 
time. We thus define a smooth orbits T st (t; g{) in such a way that T st (t; gi) = T(t) for t > 0. 
The values of T st in the other region are determined by the requirement of the smoothness 
of T st at t = 0. Note that the orbit T st ( ; g±) is on a new energy surface. Since the two 
orbits T() and T st ( ;gi) intersect at r(0), two sets of Lyapunov vectors, denoted by e*(g ) 
and e*(gi) respectively, are defined there by the time evolution along the two orbits T() and 
r«t( i 9i) from a sufficiently long ago. (See Eq. Then, recalling the definition of KS 
entropy given by Eq.(^J), we can interpret \ogflN-2(t, 0; {e*((?o)}) as the actual information 
loss during a time interval [0, t], because the set of Lyapunov vectors {e*(g )} at t = is 




(12) 
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associated with the actual orbit T(). On the contrary, the quantity log 0; {e*(gi)}) 

corresponds to the information loss for the virtual orbit T st ( \g{) on the new energy surface. 
We now define the 'excess information loss' brought by the parameter change as 

H ex = lim[log^_ 2 (t,0; {e*(^ )}) - logfijv_ 2 (t,0; {e*{ gi )})}. (13) 

t — >oo 

In Fig. |], the average of H ex over initial conditions, (H ex ), was plotted against Ag. 
Comparing this graph with that in Fig. [|, one may doubt that (H ex ) has no direct relation 
with (AS). In particular, behaviors for Ag — > are qualitatively different: (H ex ) ~ O(Ag), 
while (AS) ~ 0((Ag) 2 ). This property implies that the excess information loss in the quasi- 
static process go — > gi, denoted by (H ex ) qs , takes a nonzero value. (H ex ) qs may be calculated 
as 

(H ex ) qs = f 91 dgV(E ga (g),g), (14) 
J go 

where \1/ is determined by an infinitely small jump process g — > g + 5g at the energy E qs (g). 
Now, it seems natural to assume the decomposition of (H ex ) in the form 

(H ex ) = (H ex ) qs + c(AS), (15) 

where Co is a constant. In order to check the validity of Eq. (|T5D , we performed the reversed 
experiments in which the parameter g is changed from g\ to g with the initial energy 
E qs (gi)- We then obtained (H ex )' and (AS)'. We assume the relation Eq. ([T5| ) for the 
reversed experiment, that is, 

(H ex y = (H ex y qs + c(Asy, (ie) 

where 

r9o 

(H ex )' qs = / dg*(E qs (g),g), (17) 
= —(H ex ) qs . (18) 

Therefore, from Eqs. fll"5|) , (|T6| ) and (p!8|), we obtain 



(H ex ) + (H ex y = c((AS} + (AS)'). 



(19) 



This relation was checked numerically. As shown in Fig. ^, Eq. ( PH| ) seems valid with 



c = 0.5. We thus expect 



(H ex ) = (H ex ) qs + -(AS). 



(20) 



This is the main claim of the present paper. It is worthwhile noting that the positivity of 
the entropy difference is expressed by the principle of the minimum excess information loss. 

In closing the paper, we introduce related studies. Recently, a relation between phe- 
nomenology of nonequilibrium steady states and dynamical system theory has been dis- 
cussed by employing deterministic models with a thermostat or with open boundaries || [| . 
In particular, an entropy production ratio is expressed in terms of KS entropy. This may 
have correspondence with Eq.(^). (Note that we never discuss nonequilibrium steady states, 
but transitions between equilibrium states.) Further, Oono and Palconi have developed new 
phenomenology of steady state thermodynamics [TIJ, in which 'excess heat' plays an impor- 
tant role in the definition of the entropy at a nonequilibrium steady state. When we replace 
a term 'heat' in their theory by 'information', we find much similarity between two theories. 
In order to discuss relations among the apparently different theories, we need to present a 
mathematical proof of Eq. (|20|) together with the positivity of AS. 
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National Science Foundation, No. NSF-DMR-93-14938. One of the authors (T.S.K.) also 
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FIGURES 

FIG. 1. Lyapunov spectrum. N = 20. Qj(t,0) at t = 10 5 was measured to evaluate the 
Lyapunov exponents. 

FIG. 2. Averaged energy after instantaneous switching processes and the equi-entropy line 
through (E,g) = (1.0,10.0). 

FIG. 3. Entropy difference versus Ag. N=20. Solid line shows S((Ei),gi) — S(E ,g ). Square 
and filled circle symbols represent (S(Ei,gi)) — S(Eo,go) for N = 5 and iV = 20, respectively. 

FIG. 4. H ex versus Ag. Square and filled circle symbols represent the data for iV = 5 and 
iV = 20, respectively. H ex was evaluated with checking the convergence. 

FIG. 5. (Hex) + (H ex )' versus (AS*) + (AS)'. Square and filled circle symbols represent the data 
for N = 5 and N = 20, respectively. The dashed line shows (H ex ) + (H ex )' = 1/2[(A5) + (AS)']. 
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S.Sasa and T.S.Komatsu Figure 1 . 




S.Sasa and T.S.Komatsu Figure 2. 
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